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FOREWORD 



T;^e Education^ i ^ncepts and Evaluatio^i Work Lnit Area of the Arznv^ 
Re~Hrch Institute |[or the Blefaavioral arid Social Sc:_ences (ARI) perrfcrsas 
research and develc*-/--'nt in areas' of educational -rdizhnology with apr:!!^- 
bi>i<SQ^ z~ military i fining. Of special interest is research. in the srea 
■ of trnrnpuner-based t-ar-i.tiing systems. The de^^elopmemL and implementa r:i 
. " ' of such systems is .se-.^-i"- as a means of reducing training rime .and obs^s by 
^.cir^;^, pro^^idiz^ Tmor - nighV' -adividualized training thar; w^ould be otherwise 

-no s lb 1=:... 4| ^ t 

T^^^ reuorz s itizes the research conducteii _jn the^development of ' 
. / -^imnputer-basad ifrslning system, the. Adaptive C:2mputerized training < 



to accomplish this resear r.n, ARI's resources 



W iiiLiii nre^ qtat riract with Perceptroilics, Inc. , an organization 
s^tffev^d 3s havni-:;; «ique capabilities f^or researc- anfl development in 



irea 



t--' ;/ :he enrlre 
//tc cnre reoT-T r^ '^^= — 
"^Ith lehavi "^~al - . 5r 
res- — ted i i _ Dnr -* -nun 
.i«*tis of R "^E ' 

-Iso ir.^iis^sototiii: z 



it^a In 7T 1974 in response 



^- ':h work liniz was in~:i- 

^ HDT&E Project 2Q16: ^2B7A5, -"Bas: c Research' in 
lal Sciences." The access of the initiaj. effort 
lion of .the research i re-^ :^•afnse to the req'uire- 
2Q762717A764, "Educ^^ ionai anc Training T^echnology/ 
he special requiremients of tne Product Manager, 



,_3 (Res -arch 



!Jfeal:=:ir 2; ~~stems, as expressec Hair^ktn Resources Needs 



for Computerized 



.^^KtC Support fzr C jm^,p . crized Training Sys: 



Systeais^ and 77-173 
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DEVELOPMENT - AND fiyALl ATION OF ^t);Wi7■^Z CO>IPUTERIZED TRAINING SYSTEM "TS) 



In 1974 the Army 3as«iarc"'- ^st:±tute 
Sciences (AHI) initiai::-Bd a prrx ve^'m t9 i 
Training System (ACTS,. Sincv: tr^^r ri-- 
technical reports, thre:a papers 
Uapr ' s manual ..^ However , nc _ 
uf-to-date sumxnary of progress 
, technical anidience. Neither i.^ 
in the context of . the rz,litary 
solve. This report * has beer, 
.the. specific objectives of -hf 

(a) To explain the ra:irrTl-r beh. 
develppment/ prograni; 




:r the Behavioral and Social 
an Adaptive Computerized 
che program has produced ^jj^ree 
software, and one systems 
prov::-des a) comprehensive 
3cted primataly toward a ncn- 
eport which places the program 
robienis which ir is intended to 
ill those needs. Therefore, 

-3 



the ACTS resea^^' a'^d 



. (b;).. . To. .explaiii:,i .in^.'^^ iv .-i ^eGhniG^l terms , what- -the ACTS 

is supposed to accomplish and '^-^w i t^c-- rates; 



and 



•(c) To provide a sumniar ,c: the lata evaluating ACTS effectiveness; 



(d) -lio - describe . propcs v 
development. 

The overall objective of 
evaluate a 1 new method tor pr'^ 
training. ^ 



There are a- number of r^ 
which are t^e need. for: \ cost 
plified procedures for the pr 
materials; evaluation of the 
"art|ificial intelligence" re 
of- training troubleshooting 
turn. . 





dJ.rections* in ACTS research and 



,:.rogram has been to develop and 
mputer-tased troubleshooting 



lor jursuiijg, this objective^ among | 
ti\ ^ individualized training^ simT ^ 
ticn of computer-based training ^ 
.cability^ of advanced techniques from 
' to Army training; ^d improved; methoc^ ^ 
res. These areas will bq /examined ir 



The Need for Individualized 



^ The . concept' t^riat traini. 

effectively if adap^red to ch-z-a 
of 'the individual student is noi 



• be conducted mcfi:e ' efficiently or 
rrifftics (such as ability) or performance 
- new one. Methods for providing su"bh. . 



-^A complete list of all publicatims ; produced^ as ^part of this; effort is. 
included, as Ap'pendis: A, "Bibliogr-L^hy of ACTS Public^rftions . " 
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iuc3ivla*ualiz.arion were developed ^=.s^ early a§ the 192C 5 CPressey, 1926) 
althoug/. not widely used. Not "unciil the 1950'^, did : •^dividual iz^t ion of 

^'^"A.^^^:?. and education become a popular ^tropic (Cro n-^A 195 7 )\ _ The , . 
firsz ap~aach to individualizat^ m to^ rfeceive mass =r ^f^ance was 
Skinner' i ^54) ''teaching machine^" and a varlaut, the linear progrranmied 
text. TnescL iBsthods nnitted each studeat to proce^ ; his own pace, 
but iastrr-r ^im al con * en^ remained tjje same fcr all s ^..ents. The : ^ 
teaching uac^izie "d- the' instructional sequence by #qairlng students 

to repeat se-ementi t^^ .»Jhich they had previously respoisvi^d incorrectly. 
In generic, '-ver -*^;?Ujnited amount of individualization was not T)ro- * 

- vided by the rro«r.^ - mfc=i text. . , . . ' , ^ 

Crowcder ''i^^ ^ de veloped both 'a , t^ching- machine 3nd a text format 
which permirr^-- U.^ mc^n:g (variation in instructional -ontenr arid 
seqyencirtg d ict:.jn of studenr responses) - in addi:iion ,to individual 
control cf p^: -- E th. the" linear and branching approaches, under the 
general tenr. - amnie r Instruction (P.I) Vave been wic^^y adopted by tht 
military and . . - . ^ ivi - i3n educational cpmmunity. Man* of the "new" 
advances in Ar — rrain.iiLg, such as self-paced instruc tion and .the Train- 
ing Extensior >ourse 'TEC) audio-v^ual; lessons , are'a -:plications of the* 
p^j^ciples o:" ?I to non-paper-and-p-ancil media. " ^ 

J .\^oth t ^nes of FI hai^e be,en relatively successful. A branching. PI 
text provide - greater capability for individualization r han does a 
linear one. lowever the commonly used textbook former ,)l^ce's practical 
limitations nn the amoimt of indiv±dualizatior possit^=, • The mqre 
branches i-cluded, rhe more cumber som^ and" di: ficult : r r the student to 
use the 'te> c>. 

/\ • -. i - ■ 

_ The aJto'ent'of real-time computers Introduced the :3paba,lity to 
provide grjftater individualization than is 'possible ^Ltz k branchii\g''pro- 
grammed te»t. Computer-Assisted Ir.struction (CAI), nh; use. of the com- 
puter to r ' '^vide instruction directly to tU6 studen_ . had its beginnings 
In 1959 (k^-:nn, Anderson & Brainerd; 1959f)'. ^CAI did nc- come ihto wide- 
spread usj_^j^atil the mid-1960's. Despite' its tremeadr-:L:s potfenfial, to 
provide \in.v'jl vidualized instructioTi^, CAI frequently n.as been a disappoiot-r 
ment^ Rese rch evidence indicates that CAI is an ef fec"ive, but not 
heCiCssaril , practical, 'method for training and education.- ' ^ 



The PrbbleiL f Preparing Cpmputer-Based Training Materials ' 

/ CAT^sy?r^eias frequently are referred*to by observers as "automatic 
page .turners.' The appellation reflfects^ -the fact that the computer ' ^ 
appears to dc 'kittle more than present a new segment (page) of 'text ' 
after the stutzL^nt has made a response. While this ^ is an oversjnnplif ica- * 
tion of the C'-rnputer ' s function in many training applications, there is 
a gt^in of triiLzh in it. Generally, capabilities of* the comp^uter for 
providing ind vidualized* training are underuti!^ized . Several re^asons 
would appear "or 'this. A few reasons^or this* underntilization will be 
examined here ' '$|fcsi ' 



FI to (|AI. 
in-'-criLCtioiial medium. 



The first reason i- .^.orical. As -^escribed* a.DOve, CAI has been 
viewed primarily as a br :t^-r method of presenting PI. Thus the practice 
:3JJ^.senting instructii^ _;-:_siiiall. segmen beeir trails f erred directly 

While 1' roponenrs claijn.that CAI is a flexible 

prr^ -_2:Lng rhe cap^bz-^ity for the uae of a variety 
or Instructional straregi- ir has in fact: been used extensively with 
crSy two of those strate: ..:^. dr:ill and practice and tutorial, the 
la-rer beinig cpnceptliaH-^ :^ntical to this PI strategy ^ 

A second reason ifi difficulty,^ rime, ^nd cost required to 

prspare highly Individus aad CAI materl =•■.,' . As compared with the 

prspars^tion of a PI text zz^je CAI author ^..>s tlie. additional task of * " 
prganizing (and "often cczr^r.'s;) the. materi£L.L- for macbljie execution, . J 
Moreover,^ the more* options jr brsnthes vx— .In a lesSpn, the mofe complex 
the ^authoring process b^zcxates.. Znct^sec r^ampiexity leads to increased; 
preparation time, which in turn _eads to -zirease'd cost of the ^lessoi^'- ' ' 
naterials. When CAI is in:roduced in an '^era^tional setting, such as ^ti 
Army school, the author^ -^i-ely have the luxury of praviding. iiidividu§l- 
ization to the^extent desirable. Ler-sons nust be prepared v^ithin a ^ 
fi3|«d, and often' very limited period it t .nie. Individualization isv 
r'Xtd^ sac^ifi'ced for efficiency of produc:^on. 

There are several po^^fble ways to F el^ the author in this situation. 
One is the development of on-line and of: -line aids to assist the author 
ip preparing lesson materials by performing the more tedious and time- 
consuming tasks. Another is through development of generalized instruc- 
tional logic routines independent of ins::ructional- content. The author's 
t^sk is then to insert the lesson conter' into a pre-existing framework. 
Unfortunately, the framewo:r'k may not necessarily be the best one for any 
particular set of materials. Ideally, tie instructional content, rather : 
than the generalized 'logic , should determ.-ne the instructional sequence. 



rJt^third method for providing individualized lesions is the development 
of computer software, systems which can themselves generate individualized 
training sequences through th^ use of an internal expert: This expert 
must be able to analyze student responses ro' determine the student's 
learning difficulties, and present the appropriate instruction to correct- 
those difficulties. This last approach requires tl^ use of '"artificial 
intelligence" t-echniques. ^ . 

The g^omise of i "Artificial Intelligence" Techniques "~ f ' 

Artificial Intelligence CAI) techniques afe algorithms* (rules) 
which enable computers to exhibit "intelligent" behavior. Examples of 
intelligent behavior are understanding written English,* playing chess, 
and learning (changing behavio/fl as a ifesult o*f experience)-. The field ' 
of Al developed in the 1960 '*s as a tool for the study .of humail behavior. 
It was assumed that better understanding o^i^omplex human behavior could 
be obtained if ,the rules whicn enabled computers to produce the 'same 
. behavior could be de^termined. ' By the 1970's^i|; had become apparent that 
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the same tecnniques could be used to enhance -CAI. , Oarboneyi's SCHOLAR 
system 1970; was the firsr to use an intelligent computer-based tutor, 
one thaJL iv^iuLd. both a-sk q uesti ons of the student and respond to unantic- ^ 
ipated :;.ues:tions posed by cihe student.. ^ * , - 

The s-dvaoitage of AI techniques is that thsy can provide highly 
indLviduii-. ^zei* and flexible ::nstruction without the necessity for pro- 
grammiing ^ne i^trucriona.: ogic separately for each lesson. The pri- 
mary diai^rssrarttage ^s the exrensive computer ^resources requited to support 
CAI systems u-'rLich use AI neeaniques, ^ In; the past, this has prev.ented^~ 
t-he u9e sii.zh systems oursi^de a research environment - Fortunately, 
. technoloj^ca- advances in computer hardware (particularly miniaturization)' 
^have resurltet-'»-in a substantial reduction in the space requirements and 
initial :c st previously associated with: ^he computer capability necessary 
to isappL r- sophisticated AI. ' ^ 

^mprov^r.g Troubleshooting Train-ing Procedures ^ ^ 

T e .^mny 's\ cur rent iipproach to troubleshooting training is primarily 
hands^ ^ anc egliipment specific. " The student first is taught the sequential 
step~bv --step procedures ecassary to locate a malfunction in a particular . 
item o. ecuipment. The., he practices, and is tested on the actual 
equipnient ^iself. This approach has several advantages. It insures 
that : le student has mastered certain prerequisite skills, such as the 
use'o: tes^ equipment. This approach also teaches the student the 
physical 1 out. of the equipment ahdc the correspondence between the 
equipnrtent irid the oircuiit schematic diagram. Finally, it gives the 
student practice in disassembling and. reassembling' tHe equipment. 




' TheiTe h r^als^HPeral aisadvantagels . Sinc'e the training content 
is equipmer s^ecirf^procedures , rather fchan troubleshbotsing logic, 
there is litcie tran'lfer of the skills acquired to similar or,,modif ied 
items of eqxipaent. Also, a substantial ^amount of equipment, which 
otherwise cculd be used operationally', is required for training purposes. 
Instructors niu3.t spend large portions of their time inserting malfunctions 
into the equipment,' rather than- actually conducting' training. Moreover, 
much student time ±s spent assembling, disassembling, and. soldering the 
equipment ,t.hus .reducing 'the nuniber of di^fe^ent equipment faults that 
they can experience during theii: training. The use. of "intelligent"/ 
computer simulation offers-one raeans/Of imprpving existing training 
procedures. 



■Objectives . * ' - ^ 

When. the ACJS pro'^ram-Was initiated it was viewed as a solution to^ 
the problems des'cribed aboVfe>r In summary, 'thie 'overall obj ectives. of the 
program have been: . ■, / , } • 



(a) To improve the Individualization of training in CAI systems 
through feki-use of AI techniques: 

' (b) To minimize the effort required by the lesson author; 

/' (c) To use relatively "basic'^ AI techniques which can be implemented 
on small-scale computer systems; 

^ (d) To evaluate the training and cost effectiveness- of the-^system 
for electronic troubleshooting traiaing. . 

' * • • 

ACTS DESCRIPTION^ ^ 

The ACTS program was initiated as a basic research effort in 1974. 
Work accomplished through January 1977 was performed by Perceptronics , 
Inc., linder contract to and with guidance proyided by ARI. The current 
version of the ACTS evolved gradually throughout this pef'iod. Previous, 
reports (see Appendix A) described the ACTS as- it existed when those 
reports were written, and^, while historically accurate, do not always 
accurately reflect the current state of ACTS development. For example, 
the ACTS has been called t^e Computerized Diagnostic and Decision Train-, 
ing (CDDT) system and the Computerized Decision Trainijig (CDT) system, 
as well as the ACTS, in different reports. -This section .^escribes the 

current version of the ACTS. ' 

1 " , 

A brief overview of the ACTS will provide'the background for the 
system description. The student'-s task in the ACTS ' training setting is 
to troubleshoot a complex electronic circuit by making various test - • 
measurements, replacing the malfunctioning part, and making final verifi- 
cation measurements. The entire process is simulated by the ACTS. * 
Neither the actual circuit nor test equipment; is required". The heart of 

. the system is an adaptive computer progra^n which ''learns^ the relative 
preference of, the student for the various test measurements, compares 
this to those of an expert, and when complete,, will provide feedback and 
adapt the instructional sequence to eliminate discrepancies between the 

^student and the expert. 

The ACTS is not being proposed as a complete troubleshoot ing training 
method. It has not been designed to train the student to use test 
equipment, assemble ot' disassemble the equipment, or provide him^ with 
background information 'about the operation of the circuit. It is designed 



^A Glossary explaining the technical terms used 'in t+iis section is included. 
Terms included in the G+ossary arp underlined vjhen they 'first appear in the 
tex-t * > 

Both male*«and female personnel Receive electronic troubleshooting t,raining 
iri^the Army. -The masculine. gender in reference to those students is used 
only to avoid the awkward structure imposed by ^'his/her" \70rding. 



t-o - train the studentr in the defcision-making aspect of the troubleshooting 
process. 



ACTS Components • . ' 

The ACTS,;ConrSists of four major components r-y Xa) ttte task, model; 
(b) the Expert model; (c) the'stojdeht model'; ani^(d) the instructional ^ 
model, , ' , ^ ' . ^ ^ 

Task Model : The task model is a simulation of the ^cwzi*^ ^'iri this * 
case an elRCtroni*" rirc-iiL) on ^hxch.t.i^ SL-jdent is to je trained. The 
circyit currentl> bein^ ust.d is. a uiodulcir veisiun of the ileatlxkit IP 28 
Power Supply. 1 A simplified schematic diagram of this circuit is shown 
in Figure 1. The power supply, whgn f unctioni'ng.'properly , coityerts a 
117-volt alternating current input' (shown at the left) into 'a stable, 
low-voltage, low-amperage^ ^direct cui'rent output * (s-hown at the right). 
As the diagram shows, the circuit consists of ten modules. Since tlie 
output of the circuit must be stable,, even with variations in the input, 
there are a number of corrective, feedback, loops in the circuit which' 
mafke the troubleshooting process more difficult. " 

Expert model , Th^ second major component of the ACTS is a model of 
"an expert troubleshooter . This is an Expected Utility (EU) model which 
predicts the expert's measurement • choicesi as he troubleshoots the circuit 
It ir uev^loped througu on-line observation of -the; expttt ' s .ti nableshoc cin 
behavior •'^ < * ^ 

- Student -model . The student model,' like the expert model, is an EU 
(Jecision model which predicts the student's measurement clioices. It is 
developed through on-line observation of the student's ijehavior as he 
solv^es troubleshooting problems on the ACTS. 

Instructional model . The last major component is the instructional - 
model. The function iof the instructional *model is ^o^compare the expert 
and student- models , oleter'mlne discrepancies between the two, and to 
modify the instructional feedback and problem presentation sequence in 
order -to reduce those discrepancies. Currently the iristructiotial model 
cai^ provide some adaptive feedback, but cannot modify the instructional 
sequence." / ^ • ' ^ 



The Expected Utility Model 
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The uniqueness (and promise) of the ACTS lie^ in the use of the 
expert 'and student models. Since they are so important to ACTS 

» * ■ 

■■•Commercial designations are usfed only for precision of description. Their 
Use does not constitute endorsement ^ by Departiheht of the Army or the Army 
Research Institute. * ' * ' 
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Figure 1.' ACTS Circuft Diagram (from Crooks, Kuppin, & Ereedy, 1978). 



operation, ^they will be, e^cainined in greater detail. WThile the two* 
.ihb'dels^'e^ve difffer^rit functions *aiTd use different iiata/their operation 
Is ^identical. ■ -^'J . ' ' . r- a 

' Consigier an^xpert/ttrNoubleshooter who is giy^ni^-defiective .IP-28 . 

powe:;.^ supply andVimply ''to;id Vlt doestt ' t^ work. " Fix itl^V If he chdos.es 

.'to 2*epair vi't^ thej:eVare a limited number of actions that he can take. ^ 

.The troubleshooter can use the switches and meters on the^frorit Dane 1 of 

.th^ power supply'to chetj^'any^ of the fout outputs. He can take any of. 

, the 2*5 possible internal test measuremehts. Or this expert can replace 
' any of t^e 10 .circuit .modules . ' • . ' • > • ' 

Each pf 'these possible actions hag associated witlflPit a set of 
possible outcomes. For example, measuring the output voltage'^Vi^h the 
•vo-Itage setting in the high state- cp.ul'd produce outcomes of pormal, low, 
very J-pw, or z^ro^^ Module -E, the current source, could be good or bad. ' 
If good, replacing 'module E woyld not corr.ect'The Cj^rcuit malf unction. 
If baa, replacing tlie current - source would correct the malf unction. 2 
Each pt^sible outcome has three properties. ' The first is the conditional 
probabiTl-tj^ o f th,e occurrence o¥ -that outcome given -that' the appropriate 
action is selfeT5*ed-^nd giv^n the previous measurement outcomes.* For 
example, given the previous measui^einent ..results , what is the probability 
that measuring the output voltage witli the voltage setting in the high 
state will result in an outcb'me of zero^? The second pxpperty is the 
> utility , of the^outcome.tp the trdubleshooter , i.^. , what he gains or 
loses as a* result of that -Dutcoi^ie. Utility is sutjjective, but it should 
be related, to the cost (in time or money) of taking 'that action.. The, 
third property is the gain in information, that t^e outcome provides 
• about the , location of the, fault.. Information gain Is a function of the 
'nymbefof faults in the circuit that would be eliminated if a particular 
result werq, obtained. 

The expert and student models combine these three properties to 
obtain an "expire ted utility *' for each possible action"^ The higher the ' 
expected utility Pf an action, the more desirable that action becomes. • 
The properties oare ^combined as f ollows; ' ' 

- EUj-^Ea^^Pij U... . : - : - (1) 



When using the actual equipment, of course, the outcome would he a 
numeric . value. :The troubl^^'^ooter next would have to. determine whether- 
this 'value *wasShigh, medium j^fow, etc. ' ' 

2Again, this, is A simplification. The current source could be "bad'J' in a 
number of ways/. ' ... > 

^ 8 '.. . 



" 'where 



the' expected utility of action - ' . . 

the^ probability J:hat outcome i , of ^set of n ' ' 
'outcomes, will qtcur- if action Aj is selected^ " 

the utility of outcome i of action Aj 

the 'in'f ormation gain resulting, from jthe occurrence gjf outcome 
i of action A j . . 

' In other words, the^ expected utility of any action is the sum, across all 
possible oii-tcomes- of that. action, of the producr of the probability, 
utility, .and information gain of that outcome. ^ ' • ' \ 

While it is assumed that human troubleshoot^rs comj^ine the properties 
in this 'fashion, and choose the action with the* highest expected utility,^ 
this is not a necessary condition for ACTS operation. It is sufficie^nt • 
that the model predicts the actions of the humen- troubleshooter accurately 

■ .' ..-•■"» - ■ ■ 

An example of the operation of the expected utility model is shown 
at Appendix B\ . . 



Developing ACTS Training Materials 

While the" basic ACTS model is at)plicable. to -any diagnostic task , 
task-specif ic "information must be provided before training can begin. 
The first step in obtaining this information is \to prepare d table 
similar to Table 1. This table, developed 'for the IP-2S power supply, 
shows the outcome for each vof. the measurementis for- each of the possible, 
circuit faults. This 'information forms the basis for the , task model 
(circuit simulator) and is necessary for the cievelopmefit of the expert 
and student models. ; »/ . * 

The second step is to determine the probability of occurrence of 
each possible fault. The simplest procedure is to assume that all 
faults are equally likely to occur. , This method is especially appropriate 
for new circuit's for which no information about' failure rates of the 
components is available. A more accurate representation of tfhe on-the- • 
job situation can be obtained by using piwbabilities, which reflect the 
frequency of occurrence of each fault in the actual equipment . This 
information could be obtained from examination of maintenance records. 



It sho.uld be noted that the ACTS EU model differs^ from the basic EU model 
described in the Glossary. Information, normally a: component of utility,- 
is 'treated separately in the ACTS.., 



Table- 1 

' Measurement Outcomes .Associate*d with CircliiJ: ' . 

" . ' Faults in the' Heathkit IP- 2.8 Power Supply . 

(Blaak spaces are Normal outcomes) (From**Crooks , Kuppin, S Freedy, 1978) . 
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If * the -records are not available, estimates of the frequency of fault - 
.,occurrence could be obtained from experts. , . 

. ' * * i 

Given t;he table .of faults and measurements and the probability of. 
occurrence of each fault',- the ACTS can calculate the conditional proba- . 
bility of occurrence and information gain of'feach outcome- as shown in • 
equation 1. When, modules can contain more thati one possible fault,, the 
ACTS also can calculat?e the probability that -particular module is bad. ' 
Equatipns for these calculations are shovm^in May, Crooks, and Fr.eedy 
(1978). ' ' ^ • * ^ . 

Next /thel costs f o^r each measurement and** module -replaconent must b^ 
cfet.ermined. In general, measurement costs should reflect' .the amount of 
time required to take th'at measurement when using the actual equipm'ent. 
The cost of replacing a module should reflect amount of time for replace- ^ 
ment and cost of the new module. The costs are presented to the istudent 
in- dollar amounts. ' ' 

- ■ . . •■ ; - ■( . • . ' • 

Programming the computer to display the circuit diagram is the last 
task before the- expett model can be trained. Ttiis training piTocess 
results in the utilities for the measurement outcomes as shown in. equation 
1. Referring once again* to^. this equation, it can be seen that there ar^ 
now two sets of unknowns remaining : the expected utilities for each 
possible action, and the utilities for ^ach possible outcome. These 
unknowns are estimated by ;"tracking" an- expert^s troubleshooting behavior 
as he completes a series of problems on the ACTS. As he does this, he. 
is presented with the updated probabilities of measurement outcomes. ' 
The values of the. known model parameters (probability and information) 
are entered into the expert model before the expert ' starts , with, the 
utilities set at some common arbitrary value (usually 100). The expert 
model chooses the action which has the highest expected utility. If the 
expert then chooses, the same attion, no changes in the model are 'madefc- 
However, if the action/selected by the expert model differs, from th^ ' • 
action selected by the expert,, the model utilities associated with the 
model choice 'are punished (decreased) and those associated with the 
expert choice are rewarded (increased). This process continues until 
the estimated tLtilities become stable. This will dccui: when the expert : 
model is able to predict the choices of the expert accurately. 

At this point,' the expert is no longer needed; The expert mc:iel, 
having been "trained," replaces the human expert. Now the system 3 
ready to begin training the student. ^ As did the expert, the student 
begins to trQubleshoot . As he does this, he has access to- the probabili- 
ties produced by the expert mddel. ^ 



%ote that no mention has been made of techniques for modifying the 
instructional sequence or for providing feedback to the student. T'-e 
methods- for accomplishing this have yet to be determined, as will b^ 
discussed in a later section- of this report. 
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As the student' solves a series of prbblemsi tne student model, 
which functions in the same manner as dOes*^the expert model, learns the. 
student 's utilities.. When 'the estimated student uiilitie^ begin' to 
stabilize, feedback can be provided -"to the student . 

,Studenf Interactions ' .* ' ^ — ^ *• ' ' ^ ' ' 

The student display., as it appears at the start of a problem. Is ' 
shown in Figure' 2. It has fouf apas: Ca) the circuit area; , (b) the* 
main message area; (c) the considerations area; and (d) the legend/ 
error-message area. The circuit area contains a diagram of the circuit," 
along witjl^the measurements that the s^tudent can take, aud the cost^for ' 
each measurement. After a measurement haC9 been ..made, the out come'* is ' 

vr-displayed instead of the cost. The .considerations area is used, to' 
presaitt^the outcome probabilities to the student. The main message area 

/inforros the student of his options, and also provides .instructions "and' . 

•assistance. . The legend/error-tnessage area provides a legend interpreting 
^he . codes by^ which the probabi]^ties are displayed , ^nd. is also used to\*l 
info;^ the Student when he has taken an "illegal" action. All .student /-^ i ' 
inputs are accomplished through the use of' a trackball and cursor.. '\ - 

Figure 3 presents a flow diagram of the- student interactions with 
the ACTS during the training process. At the start of a problem, the 
student is told only that the circuit has' a ijialf unction which he is to 
correct. Initially, the student can select one of five options. The 
first is to ask for HELP. As sliown in Figure 3, this ot)tion is available 
to the student whenever he "must select some actipn. HEi.P provides the 
sti^dent' with two types of information from the expert model: (a) a list 
of the circuit modules that could be bad; 'and (b> the. action that "the ■ 
expert would take. next.' ^ . * , 

The second option that the student can select is to enter his 
choice of symptoms for consideration. Symptoms, which are measurements 
made on 'the final output of the circuit, are distinguished from the 
internal measurements. After . the. student chooses a syiijptom for considera- 
tion, the expert model's probabilities for the possible jj^utcomes of a 
•check of that S3miptom are shown. The student may choose to consider ' 
'|0ddtional symptoms, select one of the symptoms 'considered, or choose 
none of the symptoms and return to the action selection choice point'. 
HELP is also avail^able. Selecting a symptom causes the outcome to be ^ 
displayed, and then return^ the student to the action selection choice 
point . 

The third option that the student can select is to enter his choice 
lof. (internal) measurements for consideration. The sequence of interactions 
for this option is the same as for the. previous option, entering a 
choice of symptoms for consideration. 
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.PROBLEM NUMBER: 1 



TOTAL COST: $ 



CHOOSE; A SYMPTOM, measurement;, OR MODULE. 

REMEMBER TO LIS^T THE 4 AllT^ftNATIVES THAT YOU- CONSIDER. 
•MOST IMPORTANT;' THEN CHOOSE ONE FROM, YOUR LtST. 

ROVE THE .CURSOR TO THE POINT ON THE SCREEN -THAT YOU RANT, 
: THEN /RESS THE " ENTER" BUTTON. ' ' . . • > ' " 

PRE^S THEV'^NTElrtL'tTON ONLY WHEN THE 
IS ON..^- « ■ . . 
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Figure 2. The ACTS Student Display As It Appears at the Start of a Problem^ 
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The fourrh option ;,3 to ente-r a choice of modules to be considered 
for replacement After the* student" cliooses a module zoi consideration, 
-*the expert mode^ rrobability that that module is defective is shown .to 
^the student, "^^b Jf*^^^- consider additional modules choos'^e to ' ' 
replace a specai^ X^dule. or return to the ar6uion selection choice 
point. Again, flgflfts r -liable. If tfia stijflent chooses to replace a- 
;module, the ye^^^^Ent is. simulated .and the student is* returned .to- .* 
action^ selectio^^^Klc^ point. . r . ^^y. . ^ 

^ - The student^ s final optiou is to declare the circuijt OK/ If the 
-student'^ is incorrect, jje is given feedBlck to this effect and returned 
to the action selection choice point. If correct, the student is' 
informed^ that he has ^corrected the circuit malfunction. "At this point 
the utilities in the stu-dent itiod3l ^re updated and a performance summary 
is printed for the experimenter . If a block of problems has been com- 
pleted, the stucfent iray be provided with feedback "based on , the student 
model utilities. Otherwise, a new problem is initiated. 

. ' ^ • ' - " . ■ ■ ^ 

^ • EVALUATION ' . . . 

A one-year effort was required to develop t-he basic concepts for 
ACTS development and to produce the basic software to test tHose concepts 
Since the basic software was ciomplgted at -the beginning of 1975, the 
ACTS has undergone concurrent dewTopment and : evaluation. Major items 
awaiting development are the utility-based feedback and the modification 
of the problem presentation sequence on the basis of student* utilities. 
However, since evaluations have been conducted concurrently with the 
deveiopmenr process, there are sufficient *aata to show that the major 
requirements for successful ACTS operation have been mec. 

The^ most basic requirement is that the utility estimation algorithms 
(which estimate the expert and student utilities) opeVate .correctly. 
This applies to both the expert model and the student'^moci^ . Several 
tests of these algorithms have been conducted. 

The 'first were conducted using pairs of selected measurements. An 
arbitrary set of utilities was^^6hosen for the normal and -lonormal out- 
comes of the two measurements under consideraiticn . ^ 

A troubleshooting problem was initiatefd and an experr used the 
arbitrary utilities to calcu,late the expected utilities or those two 
measurements, according to the EU model described previously. The 
expert consistently chose the measurement with the greater expected 
utility. Ttiis process was repeated for several problems using different 
measurements. Figqr^ 4 shows the change in the ACTS-derived utilities 
fbr the two outcomes. (normal and abnormal) of two selected measurements. 
In this case, one of. the utilities had an imposed value of two and the 
other three had an imposed value of one. This figure shows rapid stabili- 
zation (the utilities ddd not change after the second decision) , and a . 
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Figure 4. , Estimated. Relative Utilities For Normal and Abnormal Outcomes 
of Two Measurements (6 and 9) as *a Function of the Number of Decisions'' 
(from May, Crooks, & Freedy, 197 8) .i^ 
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rank orrfefring siiBgllar -.'to tl^t of the imposed values. i^^TKese tests 
indicated that the .utijity graining algorithm ■was\''6perating correctly • • 
for pairs- isolated measurements. ' * ^ " " • . 

A subsequent test was made by^ an .^expert who used a consistent ' 
overall deci^icn strategy. Most ^ of the available measurements- were ' 
Lused. Fallowing 14'. probleiA? (7,0 iiieasureroent-selection -idecisions) ' \ ' j ' 

the ixtllities' that Jiad- been adjusted by* the A'CTS stabilized at 'levels, 
which corresponded to their ranging in t'f^e decision 'Strategy used .by the 
^^xpert. / \ . - ♦ . . 

The jsame' utilities were alsQ inserted in a. "simulated student" , ^ 
program to provide art additional test;of t^e utUlity aidjus^ment algorithm. 
Conditions were such that/ithe student utilities were "knovm" and the'^ 

'decision-maker gas complet*ely consistent. The- simulat^ed student is a^ 
routine which ^troubleshoots the circuit ^using' any 'set; of utilities with 
which it may havje beer^ programmed . It always choos^es the action with 

♦the highest expected' utilit^y. 'The resulting utilities produced . by the : - 
uti^l^ify estimation algorithm were in a siip^^lar rank,o|rder' to fh^ simulated V,- 

V.student's utilities. ' ' . ' 

■ # * • / ' ■ • . 

Since the expert model and* the student model are, in . essence , . 
identical, it can be assumed that if the (expert mo^el functions properly, >v 
so does'ther student model. Nevertheless; this assumption was checked by 
conducting a test of ' th^ adaptive student model similar to that pre- . 
viousit.y describe ^o"c the expert model. The s^iccess of the student 
model in predici .ng -thd^ actions selected by the simulated student is 
shown. in Figure .. . "Accuracy increased rapidly during the first 80 
decisions (approximately 18 problems) , and perfect success was achieved 
afteir 210 decisions (45 problems) . ' - 

The^ tefsts described above indicated that the adaptive utility- 
estimation algorithms operated correctly when the students or experts 
made decisions consistently. The, next Series of tests was conducted to 
determine how the ^e algorithms performed when the decisionmakers were 
less than petfect y consistent. . ^ . */ 

The firs Lest with a person not following a predetermined ti^oubleshooting 
strategy used m expert electronics technician. He solved 30 troubleshooting, 
problems using the ACTS while the utilities of the adaptive model were 
adjusted. In a post-sessign interview, " the technician was asked why he 

ected specific measurements* and his estimates of the importance of 
those measurements . -Those indicated as critically important in trouble- 
shooting were videntif ied as the key measurements. Figure 6 shows the 
adjustments ro and stabilization of this expert's utilities for normal 
measurement outcomes of. these key measurements. Their rartk order is thNe 
same as his verbal ranking -of their importance. 

A subsequent study was conducted to examine the performance of 
experienced electronic technicians. Eight students who scored high, on a 
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Figure 5. Student Model Predictive Success During Simulated Student 
Performance' (from May, Crooks, & Freedy, 1978J. 
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Figure 6. Estimated Relative ' Utility for Key Measurements as a Function 
of Fault Problems (from May, Crooks, & Preedy, 197^). 
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written electronics knowledge test were given 4 1/2 hours of experience 
on the ACTS', ^^ivided intdVthree' sessions. During the second of these * 
sessions, .they used the expert*^ estimates of action * out come 'probabilities 
as an aidrin their selection of trpubleshooting actions. During the 
first and'4hiVd sessions*, /the probabilities, werd not provided to the 
•'studants. ^ ' < . , ' * - 

The stucjents improved , their decisionmaking speed throughout the " 

* three- sessions. The ^mean and range of decision time per|fo.rmance''',are . 
presented in Figure ^7. Figure 8 shdv^s 'student ^e^^isian ^efficiency; ^' 
in^easured in decis:±ons' per^^^problem. ^'The figure also' shows the' students !: 
.dependence on the. outcome prQbabilxties provided by the Expert. Wh^ 
.the pirobabilftiefe'-w^re' withdrawn .in" the' third session, tK^ students ^» 

. decisio'n efficfency decreased. ' ^ ^ " 

^ Tfle^'mean pr^ictive succe^s^ of the adaptive ^student model^ was also^^-. < 
•assessed during 'Jtfiis^ tfest,: as rshowri .in Figyi^ SH, During the second*ses'- 
sion, when the outcome probabilities .were presentee^, the^model predicted ' 

75% of th4 etudents ' choices correctly. • ^ ' ' ^ 

• ' , ■ . . . «i 

; At this 'point iii the evaluation' {Process , the fdlldWing ^ conclusions 
^can Ife made. First, »the adaptiv'e utility estimation algorithm can 
predict, afnier practice, the performance, of a, consistent decisionmaker .» 
Second, the adaptive .utility* festijnat^bp algorithm .accurately^ratnk-brders ^ 
th^ utilities, of ah exf>eft technicia*ft.« ^ Third, the presentation of 
outcome probabilities improves bot-h student performance and the predictive 
power ot the student "model. Finally, student 'performance improves with 
, 'practice o'n the system in\lie absence of any feedback regarding utilities, 

f . ^ ' ' . . . ' 

L " ■> . ' '' 

' ^'ADAPTINQ TRAINING ■ 

The ACTS is still not (Complete. ' The mfiij or difficulty has been the . 
development^ of the mechanism (or mechanism/) by which the training is to ' 
be adapted ^ to^ individual performance! Ideally such mechanisms should 
affect both the, feedback that the student receives and the sequence in 
which problems are presented, and'' should be based on the student '-s 
ufilitiea. This has turned out to be more .complex than anticipated. 
One reason is the sheer volume of *>ihf ormation provided by the utij^ities. 
There is one .utility for each measurement outcome, and one for the 

* replacement of each module. In the^ase of the IP-28 power supply^ 
there are 96 different- utilities. Table 2 shows a sample set of student' 
utilities. ' * * . . y' 

^ * • .* \ - . ^ ' 

Thus far two methods of providing feedback to the student, one 
using student utilities, have been d^eloped. Neither method alters the ^ 
(problem presentation^ seq^iience. The'fir^t, and simplest ,^methoTi presents 
the. /fexpert model^s action choice fo the student Vfter the student has - >^ 
ma^e^ his selection and olftained the result. Student utilities do not 
p^ay !^ paifjt in thisvf eedback sequence, but the expert model is r^quireH 
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Figure 8. Student, Decision Efficierlcy (Oicisions/Problem) as a Functif)n 
-of. Training Session (from May, Crooks/ & Freedy, 1978). 
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Figure 9." Student Model Predidtive Success as a Fur^ction of Fault 
Problems (frbm May, Crooks, & Freedy, 1978). . ^ 
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Non-normal - Non-norial ; Non-normal .Module Utility for 
Outcome 1 Outcome 2 Outcoi^e 3 . Code Repj^r^Pr^f 



100 
1-24 
401 • 
33 ' 

a.oo. 

100 

100 ' 

'47 

100 

100 

lOP 

100 

100 

100 

100 

lOO' 

100 

100 

100 

100 

100 
100 
100 
108 . 
100. 
100 
100 
86 / 
100 



100 
113 
100 
60 
10.0 
100 
100 
34' 
100 
100 
86 
86 " 
100 
100. 
100 \ 
100 
100 
100 
100 
.00 
.113 . 

100 ■ 

1-00 

100 
•100' 
•100 

100 

100 

100 



Sl( 



100 
100 

9'2 
. 81 
100 
100 
100 

90 
,100 
100 

86 

86 
. lOO 
100 
100 
100 
' 100 

■ 100 
100 

^ 113 
100 
100 
100 

■ 100 ; 

100 • 
113 
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log 

'lOO * 



B 

.c 

F 
G 
H 

"l 
J 

.K 
L 



100 ■• 

100 
100 
100 
100 
100 • 
.100 
100 . 
100 
100 
100 



•.■■*5 r .-I; 

■ /- 

|.. . f\ •■» 

■*. ^ 



to make it practical. Determination of the "best" action at any. point 
.-^'^ ^^^-^^^^^-li^j^^^^^-^^^ account f or the previous actions 

taken and results . obtained by the . student . . Between 4 and 12 sequential 
actions (decisions) are required -to repair the circuit, and initially 
th^e student can choose from among 39 possiblie actions. To program all- 
of the. best choice^ using a logical branching technique vould be, at 
best, .a rather complex task. 

The second method of providing feedback is based on comparisons 
among "key" student utilities. The key .utilities are those for measure- ! 
ments identified by an expert, as being, of critical importance in the 
fault isolation process. For the IP-28 power supply, the utilities for 
the outcomes for six measurements were considered to be key. Based on 
the relationships anjiang these utilities, a set of -six decision rules and 
feedback stat;ements were developed. Samples are shown in Table 3. ^he 
decision rule for^the first feedback statement should be read as follows: 
If any of. the utilities for measurement 3 are'less than any of the 
utilities for measurement 19, or if any of the utilities for measurement 
3 are less tharuanv^of the utilities fdr measurement 11, present this 
feedback statement'to the student. i 

'The , appropriate feedback statements initially are presented to the 
student after completing the 15th problem, with updated statements 
presented every- 15 problems thereafter . The student can review them at?^ 
any time,. . : \ * 

/. ' FUTURE DIRECTIONS ' •/ 

< , ■ ' * '■■ 

At some point in the development^ and evaluation of ^ any training*^ 

.^ystem^i the developers are faced with a dilemma: should continued ' 

;.f^f forts be made to improve the system, or should further - development be 
:$t0|>p iji its -current state? The first ^Itema- 

^ tiye^,c^^^ end product, but delay^ evaluation., and * 

/ cprt^^ The second alternative offers a potentially 

...l^esi?^^ but earlier evaluation and implementation. 

'^^^J'v^ut^ currently facing the ACTS. On one hand, there 

^'-^r^e^Ja-vriu^^ of questions Remaining to be resolved and improvements tq 
^le\^^4^, . p with regard to. providing feedback to the student 

ariid altelring the problem presentation sequence. On ttie other hand, the 
ACTS appears to have the potential, as it currently exists, to improve 
Amny troubleshooting training. For these reasons, future ACTS research 
*and development will follow two initially divergent, but converging, 
paths. . 

One p^th will be directed toward evaluating the training and cost 
ef f ectiveri^^s^ of the ACTS in an ongoing course of instruction ^at an Army 
school. ^As a prerequisite to thfs, laboratory evaluatijDns <r111 be* con- 
'ducted to odet ermine: (a) the transfer of ACTS training to the actual 
equipment; (b) the relative proportions or training with the ACTS and • 



Table 3 



Sample Decision Rules and Feedback Statements 



■ ' f 

Rule Feedback 



3<19 Although measurement 3 is located at a good point to. isolate 

or the power input mo'3ules, it is expensive. Use this measurement 

3.<11 after you have eliminated most other possibilities. Measure-* 

ment 3 should be used when the probability 'ot a normal ' outcome . 
jf is rath'er high but not cettain (a raiige of 60% to 80%) . 

2<11 A good first step in checking the operation of. current and 

,or voltage feedback loops is to check the output of the. series 

3<11 ^ regulator. This should be done^with the circuit operating at 

or full output since this fully exercises the circuit functions. 

4<11 . Therefore, measurement 9 or 11 should be used even if there is- 
a low probability of a normal Outcome. - Use- measurement 11 

" since it is much cheaper thani9.' ^ - x 
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■ tfraining with the actual equipment required for optimal training effec- 
tiveness; and (c). the effects of_ variations in the problem presentaVipn 
sequence on student petformance,- Changes made in ACTS software wili,"^ in 
general, .be limited to those required to install the system at an Army 
school. Guidelines for the use of the ACTS will also be prepared. 
Finally, an evaluation will be conducted at the school. . . 

^ ■ ■ * " ■ ■ ■ - ' ' - 

.Concurrently, research will be ^conducted as a Msis . for the development, 
of a ..second-getieration ACTS. Research topics will, include the extent to 
whtch expert utilities, agree, the use. of student- utilities as a criterion 
for stopping training and evaluating student performance, and the develop- 
ment of diagnostic measures based on student utilities.. 
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APPENDIX B:. -.AN EXAMPLE OF THE OPERATION OF THE. EXPECTED UTILITY (EU) MODEL 



^ There is a- very sinrole circuit 'which can fail in only one of four 
possible, ways- These possible faults are. labeled A, B, C, arid D. tlfere 
are also only four possible test measurement's that. can be taken. These 
measurements are identified by the numbers 1^ 2, 3, . and 4,;* and have^ 
costs associated with them of $1, $2, $3,, and' $4 , respectively. Each 
measurement can have one of -three possible outcomes, Normal (N), Low 
(L) , or High "(H) . ' The following table shows the relationships between 
the faults and the possible measutement -outcomes. , 



^Measurement 



Faults ' 


1 




2 - . 


3 




OK y 


J N 




N ' 


N 


N 


* A 






L 


H ■ . 


H 


B 




< 


-N 


H • 


• ;l 




N 




N 


H 


L 


. D. 


H 




H 


. H 


H 



All faults a,re equally "likely to occur. When the troubleshooter is 
given the circuit for diagnosis, he knows" that the circuit is not "OK."- 
Before any measurements are taken, the probability of occurrence of each 



of the measuremen;t , outcomes, is as follows: 



Measurement 
1 
2 

3" • 
A . 



L 

.50 
.25 
.00 
.50 



Outcome 
N .* 

.25 
^ .50 

.00 

.00 



H 

.25 
.25 
1.00 
.50 
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The amount of 4^formaticn -resulting from 



each 



outcome is: 



■Measurement 
.1 . . 
2 

_ - . ■ i . 



> 



■ 


Outcome 




■ L ■ 


N.- . 
i. , 


H . 


•50 


.50. \ 


• .50 


.50 • 


-.50 ■ 


• .50 


.00 


.00 


.00 


.50 


.00 


.50 



Assume that the utilities for all possible outcomes (Z, N, and,H) of anyV 
measurement are the. same, and that that value is equal to the reciprocal^ 
of the cost of taking that measurement. The utilities for the. measure- 
ment outcomes are then: ^ . . 



Measurement 
*' . ' 

■ 1 " ' . 

1 2 



( 




.33 



- \j 



.25' 



- .Outcome 








• \ ■ 


H 


1.00 


1.00 


.50 


.50, 


" .33 


.33 






'V .*.25 ■ 


.25 



The expected utility for each measurement is Calculated as the product 
of the probability, utility, and info;rmation for each outcome, summed 
across all outcomes for any measurement* ' , 





V 


Outcome 




Expected 


Measurement 


• L 


N 


H 


Utility 


1 


-.25 


,.125 


.125 


.50 , 


- 2 ' . 


.0625' 


.125 


.0625 


s .25 


3 


.00 


.00' 


. 00 


.00 

/ 


4 


.0625 


.00 


.0625. 
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Measurement 1 would- be chosien by the EU model because it has the highest 
expected- utility*.^ - • . ..- - . . . 

^ ^ ■ ■ " . * 

Now assume thajt measurement 1 is 'taken and an outcome of^L is 
obtained.' This eliminates faults ,C ^and D fi:om consideration. The table 
showing the relationships between faults and outcomes. can be reduced to~ 
the following: ' . 







Measurement 




.Fault 


2 


3 


• .- '4 


A 


L 


• H 


.. H 


B 


■ N ■ 


H , 


L 


The probabilities of measurement oytcomes are^^now: 






Outcome 




Measur.ement 


L 


N ■ 


- H 


2 


.50 


' .50 


.00 


3. 


.00 


.00 


1.00 


4 • ' . 

> 


• ■ .50, 


.00 


.50 


The information 


resulting from each outcome : 


is: 








4 






Outcome 




Measurement 


, L 


N 


fi 


• 2 


• .50 


.50 


.00 


: 3 . 


- . 00 ■ 


.00 


.00 


4 


.50 


.00 


.^50 
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The utilities for each outcome remain unchanged. The expected utilities — 
„-for-^eaxJx measurement then beeome:- / , . 1 



♦ 



Measurement 
2 

3' . 

•9 

• • ' 4 



t 





Outcome 




.Expected 


-L • .- 




h' '"- ' 


Utility ■ 


• 125 - 


. .125 


.00 " 


- ,-25 


. 00 ' 


■ .00 


.00 


_,00 


.0625 


.00 


.0625' 


.125 



The exp^cffed utility model in this qase would choosa measurement 2. 



•.■1 



\ 
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GLOSSARY , 

- « ■ . # , 

This glossary contains* an alphabetical list of 11 technical terms 
used in this^ report.. In parentheses immediately following the term 
itself is a list of other terms, also in the glossary, with which the 
reader should b« familiar before reading* that definition. 

^ ALGORITHM — A rule fot .performing computation or solving a problem. 
For example: "To finti the sum of 'a pet ®f consecut^je ^iximbers , ^ pne, . 
through N, >aultipljr the largest number (N) by one p^Ts the largest - v 
number - (N +rl> -aind divide the result by two. " ' ' - '■ ' • 

: . ;.. ' • . ■ ' , - • . ■ 

. CONDITIONAL P.ROBABILITY (PRQ^AbILITY>— . The probability that a particular 
outcome (A) will be -obtained if some dther outcome (B) has previously 
been obtained, or, in other words, the probability of;^qut(^me A conditional \ 

. ugon B. Some, outcomes arte independent : the ocaurrenc'^e of outcdme B has 
no efifect^on the^ probability of outcome A. For lexample,^. the outcome 

v^obtainecJ on ohe t>^ow of a die has no , effect on Vhe probability of. 
obtaining a particular outqoine on another t'hrow of the s^e die. Con- 
ditional probability is/ relevant only to nonrindependfent events. Assume 

^th^t l!!wo ^bnsecutive ibh^ows, of a die are to be made, and that the { 
favorable outcome is a total of isix on the two throws. Before the first 
throw is jnade;, there are 36 possible outcomes, five of which (1-5, *2-4, 
3-3,,A-2,^and: 5-J) will produce^a total of six. The probability of 

^ obtaining 'a . total of six is therefore 5/36, or a^ppraximately 0.14. Now 
assume that the first throw Is made* and a^ four. ite' obtained. There are , 
now six possible totals that* could l?e obtained 65, 6, 7, 8, '9, and ^10) , - , 

*^orfly one of^wbich-is, six. The conditional prob^ility of obtaining, a 
total of six given that the'outcome of the first toss was a four, is .a. 
therefore i/6, or approximately 0.17. * . 

COST (VALUE) Negative value." • ; ^ , ^ , 

^ ; "-^ ■ ' . . 

DIAGNOSTIC TASK — Any task which requires an individual to determine' 
the cause or nature of, a problem or situation. Electronic troubleshooting, 
mechanic maintenance, and medical diagnosis are, common typets of diagnost4.c 
tasks • , ^ . • ' 

<*•_.'. , , 

• ■ " ' ' . \ * 

EXPECTED UTILITY /(EU) (PROBABILITY, VALUE, QgST, UTILITY) ~ A* numerical 
expression oJ'the anticipated subjective worth to an individual of 
taking an action, when the outcome that wil^ reteult.from taking that 
Action is uncertain. Mathematically, if, there are N possible outcomes,.' 
each having a probability of occurrence Pj^, and a utility Uj^, then 



Eli = Pj^U]^ + •^2^2 + P3^3-+ • • • + PnUn 



or 



* N 
. • EU = Z 
i=l 

^ ; ■ ' / ,<} •*' 

As, an illustration, consider the following situation. ' You have just . 
arrived in a distant city for an important meeting the following daK 
In your hasty departure, you forgot to'pack your raincoat. Weather ^ 
reports indicate a probability of 0.50 that it wfll^be f^tir tomorrow, a 
probability of .25 that there will be light rain, and a probability of 
0.25 that there w^Ul Be very, beavy rain. You definitely will be exposed 

^ to the weather , and it is*- veiry important to ydu.^that you arrive at your' 
meeting In a. dry dondition. You enter a clothing.^tore which of/ers two- 
types, of raincoats : inexpensive, which'will protfect you against a light 

^rain, ,but offers little protection against a heavy rain; and expensive, . 
which, will protect, you against flight qr heavy rain. • You cannot wait 
until tomorrow to decide what' to do. You 'carefully consider your, three 
. possible. actions^ (buy nothing, buy the inexpensive raincoat, and buy the. 
expensive' raincoat) and the three possible weather conditions (fair, 
light/rain, and heavy, rain), and. determine your utility for each action 
under each weather condition. lli'e results are as follows: c 



ACTION 



' bu^r 
nothing 



fair 
(P=.50) 



WEATHER CONDITION 

light rain 
(P^.25) 



-30 



heavy rain 
(P=.25) 



-100 



buy inexpensive 
raincoat 



-15 



0' 



- 30 



buy expeni^ive 
raincoat 



-75 



-65 



If you buy the appropriate raincoat for the. weather , you* "break even." 
guying too little protection is unfavorable because your , appearance wifl 
Jje d:egraded and your clothing will be damaged. Buying too much pro-, 
tection is unfavorable because you will have spent money unnecessarily. 
Which action has the highest expected "utility? Using the formula shox^ 
■above: ■ - ^ • * / 
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EU (buy nothing) = (0.50) (0) + (0.25) (-30) + (0.25) (-100) 



= -32.00 



1 



EU (buy inexpensive raincoat) = (0.50) (-15) + (0.25) (0) 

+ (0.25) (-30) 
= -8.25 , • 

t 

EU (buy expensive raincoat) = (0.50) (-75) + (0.25) (-65) 

+ (0.25) (0) 

• ^ . . - = -53.;75 ' ; 

Buying the inexpensive, raincoat is the action which has the highest 
expected utility. " ' * 

EXPECTED UTILITY MODEL (VALUE, COST, UTILITY, PROBABILITY, EXPECTED ' 
, UTILITY) — A model of /human decisionmaking which assumes that, when 
individuals must* select otTe of a number of alternative actions, they 
select\he action with* the highest expected, utility . " 

INFORMATION (PROBABILITY) — Information* can be loosely defined as • 
anything that reduces uncertainty about ap outcome. ^Information is 
measured "in binary digits , or bits . One'^bit is the amount of iijformation 
that will eliminate onerhalf of the alternative outcomes, assuming . that' 
all outcomes are equally likely. ..-Bieing told that the- outcome of a coin 
toss was A head, or thaf: the. outcome of a roll of a die was either one, 
two, or tnfee each convey one bit? of information. ' Knowing which'of four 
equally likely outcomes has occurred provides 'two bits of information, 
and which ftf eight, three bf&s. If the aMernatives^ire not equally 
likely, thJ^ amount of information in an N-alternative situation is 



p^l lo^2 ^/Pl P2'^°S2 '1/P2. + P3 loS2 ^/Ps Pn ^9^2 ^^^l 



N ' •• - V ■'. 

. Z p. log 1/p ^- , 

1=1 . • • - . • 

I 

where is the probability of occurrence of 'outcome i. • - . 

ft 

PARAMETER A variable term in a mathematical function which determines 
the specific form, of the function^ but does, not affect its general 
nature. For. example, the function 



V . 

y- = ax + b . 



describes a straight line. The parameters a and b determine the slope 
and intercept, respectively, of that line. The function remains that 
for a straight line no matter what specific values may be substituted 
for a and b. . 



PROBABILITY A. numerical expression of the likelihood -of obtaining a 
p;^rticular outcome, usually, called the "favorable" outcome. The numerical 
value of a probability can range from zero (the favorable outcome 
certainly wi'll not be obtained) to one (the favorable outcome certainly 
will be obtained) . Probabilities may be either objective , based on 
accepted rules for their calculation, or subjective , based on an individual' 
opin^n or belief.. Objective probabilities can be calculated in several 
ways. If it can be assumed that all possible outcomes are equally 
likely, the probability of occurrence of the favorable outcome is the 
number of possible favorable outcomes divided by the total number of 
possible outcomes. For example, the probability of obtaining the outcome 
"head" when a coin is tossed is 1/2, or 0.5; the probability of obtaining 
the outcome "3"' when a die is rolled is 1/6, or ^approximately 0.17; the 
probability of obtaining the outcome^ "queen of hearts" when drawing a 
single card from a. deck of playing cards is 1/52, or, approximately 0.02;*' 
and the probability of obtaining the outcome "any heart" when drawing a 
single card from a deck of playing cards,.isr 13/52, or 0.25. The probability 
of occurrence of the favorable outcome ckn also be defined as the relative 
frequency of occurrence of that outcome that has been observed in the 
past. For example, assume that a jar contains a very^large (infinite) 
number of marbles'. One hundred marbles have be^n drawn from this jar. , * 
Of these, 50 were red, 25 were blue, and ^25 were white. The probability 
of'drawing a r6d marble on the next draw is 30/100, or 0.50; that of. 
drawing a blue marble 25/100, or 0.25; and that of drawing a white 
Inarble 25/100, or 0.25. Subjective probabilities may be obtained for 
outcomes for which objective probabilities cannot be obtained (for ^ 
example, the probability that the Tampa Bay Buccaneers will win Super 
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Bowl 'XX), as 'well\as outcomes fot which objective probabilities can be 
obtained. In the latter case, subjective and objective probabilities 
for the same ^ outcome will not necessarily be identical. In both cases, 
subiective probabilities foif the s^me' outcome may vary from individual 
.to a.ndividual. - ^ ' ' 

UTILITY (VALUE, COST) — A numerical expression of the subj ective worth 
of an outcome to an individual. Utility is positive if the outcome is 
f avorable, negative if the outcome is unfavoarable , and ' zero if the 
outcome is neither favorable nor unfavorable; ^ Utilities^or the same . 
outcome can vary from individual to individual even fqr/outcomes such 
as monetary gains or losses. 

VALUE — A numerical expression of the objective worth of an outcome. 
The value of a $1.00 bet on a football game is-+$1.00 if the outcome is 
favorable >(you vin) and -•$1.00 if the outcome is unfavorable (you lose) 
^The term cost is frequently used for, negative value. 



